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METHOD AND APPARATUS FOR SECTIONING IMAGE INTO 
PLURALITY OF REGIONS 



BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present invention relates to image processing, and more 
particularly, to a method and apparatus for sectioning an image into a 
plurality of regions. 

2. Description of the Related Art 

[0002] Important factors in forming an image include color, illumination, 
shape, texture, positions of the objects, mutual geometry of the objects, and 
the position of the observer relative to an image forming apparatus. Image 
formation is affected by various devices and environmental conditions. Ideal 
image segmentation involves effectively distinguishing a meaningful object 
or a region of the same color from other objects or background in a form 
similar to what humans can recognize, regardless of the above conditions 
for image formation. A number of conventional image segmentation 
techniques for accomplishing this have been suggested. 
[0003] One of the conventional image segmentation techniques is disclosed 
in "Distribution Free Decomposition of Multivariate data" [D. Comaniciu and 
P. Meer, Pattern Analysis and Applications, 1999, Vol, 2, pp 22 - 30]. The 
conventional image segmentation technique disclosed therein includes the 
use of a point-clustering algorithm. The point-clustering algorithm is applied 
to detect a distribution mode among distributions of color points in a color 
space, that is, groups of pixels having a color similar to that of a target pixel 
in an image using color information about the target pixel and obtain a 
region of the same color by projecting all pixels spaced apart within a 
predetermined distance onto the image. While this conventional image 
segmentation technique can quickly distinguish a region of the same color, it 
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has a problem in that an innage is excessively segmented in a region 
containing a texture. Furthermore, another problem encountered by the 
conventional image segmentation is that it is difficult to properly distinguish a 
region of a three-dimensional object having shades by insufficiently 
considering a shading effect 

[0004] Another conventional image segmentation approach for considering 
a shading effect is disclosed in U. S. Patent No. 5,933,524 entitled "Method 
for Segmentation of Digital Color Images". This conventional approach 
includes the use of line-clustering algorithm, in which color histograms are 
used for segmentation of a color image. The conventional image 
segmentation disclosed in the above cited reference involves obtaining a 
color histogram for a specific object and converting the color histogram into 
a normalized color histogram. The reason is to reduce changes in a color 
histogram of an object that may occur in a light source under other 
conditions. Then, thus-obtained color clusters in the color space are 
described as a parametric function by three models. Here, a parametric 
function that defines a specific object is used for a measurement of 
distances between locations of color pixels in the color space thereby 
effectively distinguishing the specific object in the image. However, this 
conventional image segmentation approach has limitations in segmenting 
regions of actual image having various color distribution. Furthermore, the 
conventional image segmentation has problems in that complicated 
computations are performed for calculating eigenvalues required for 
producing a model which is most suitable for representing distributions in a 
three-dimensional space, and therefore a time taken for segmentation of 
color image becomes longer. 
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SUMMARY OF THE INVENTION 
[0005] To solve the above problems, it is a first objective of the present 
invention to provide a method of sectioning an image into a plurality of 
regions, by which image regions having various features can be extracted 
accurately in a form similar to what humans can perceive. 
[0006] It is a second objective of the present invention to provide an 
apparatus for sectioning an image into a plurality of regions that performs 
the image sectioning method. 

[0007] In order to achieve the first objective, the present invention provides 
a method for sectioning an input image into a plurality of regions. The 
method includes the steps of: (a) converting each pixel of the input image 
into color coordinates in an arbitrary color space including a luminance (L) 
axis; (b) partitioning the color space into a plurality of layers along the 
luminance (L) axis and partitioning each of the plurality of layers into a 
plurality of bins along color (a and p) axes; (c) obtaining an upper last circle by 
a mean-shift analysis, the upper last circle encircling the largest number of 
pixels having features most similar to those of a base pixel located at a 
predetermined position within a bin having the largest number of pixels in 
the color space among bins included in an upper layer; (d) obtaining a lower 
last circle by the mean-shift analysis, the lower last circle including the 
largest number of pixels having features most similar to those of a base 
pixel located at the same position as the center of the upper last circle in a 
lower layer adjacent to the upper layer; (e) including the upper last and 
lower last circles in the same cluster if a distance between the centers of the 
upper last and lower last circles is less than a first threshold value, and if 
another lower layer adjacent to the lower layer exists, determining the lower 
layer and the adjacent lower layer as a new upper layer and a new lower 
layer, respectively, and returning to step (d); (f) if the distance between the 
centers of the upper last and lower last circles is no less than the first 
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threshold value or if the adjacent lower layer does not exist, partitioning the 
cluster using a last circle including the smallest number of pixels in the color 
space used in calculating an average color, an average texture, and an 
average position among the last circles included in the cluster; and (g) 
performing steps (c) - (f) on the remaining pixels not included in the upper 
last or the lower last circle and generating an image graph using clusters 
obtained for all pixels in the color space. 

[0008] In order to achieve the second objective, the present invention 
provides an apparatus for sectioning an input image into a plurality of 
regions. The apparatus includes: an image preprocessor that smooths the 
input image a predetermined number of times, enhances edges in the 
smoothed image, and outputs a preprocessed image; a feature value 
calculator that calculates color feature values and texture feature values 
from the image output from the image preprocessor on a pixel-by-pixel basis 
and outputs the calculated result; a main region section unit that generates 
an image graph from clusters obtained by using color, texture, and position 
on an image plane for each pixel in the image output from the image 
preprocessor and the color and texture feature values output from the 
feature value calculator and outputs the generated image graph; and an 
image graph simplification unit that compares a color-texture distance 
calculated using the color feature values and the texture feature values 
output from the feature value calculator with a second threshold value, 
simplifies the image graph according to the comparison result, and outputs a 
final image graph obtained from the simplified image graph. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] The above objectives and advantages of the present invention will 
become more apparent by describing in detail preferred embodiments 
thereof with reference to the attached drawings in which: 
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[0010] FIG. 1 is a flowchart for explaining a method for sectioning an image 

into a plurality of regions according to the present invention; 

[0011] FIG. 2 is block diagram of an apparatus for sectioning an image into 

a plurality of regions according to a preferred embodiment of the present 

invention; 

[0012] FIG. 3 shows an Lap color space for explaining layers and bins; 
[0013] FIG. 4 is a flowchart for explaining a mean-shift analysis according to 
the present invention, by which the step 14 shown in FIG, 1 is performed; 
[0014] FIGS. 5 (a) and (b) shows a mean-shift analysis; 
[0015] FIG. 6 is a flowchart for explaining a mean-shift analysis according to 
the present invention, by which the step 16 shown in FIG. 1 is performed; 
[0016] FIG. 7A shows an example of a cluster formed by the method and 
apparatus for sectioning an image into a plurality of regions according to the 
present invention and FIG. 7B is a graph for explaining a local minimum; 
[0017] FIG. 8 is a exemplary diagram for explaining a fundamental region 
division map; 

[0018] FIG. 9 is an exemplary diagram of an image graph generated from 
the fundamental region division map of FIG. 8; 

[0019] FIG. 10 is a block diagram of an apparatus for measuring a color- 
texture distance used in the step 30 shown in FIG. 1; 
[0020] FIG. 1 1 is a block diagram of the color-texture distance generator of 
FIG. 10; 

[0021] FIG. 12 is a block diagram of an image graph simplification unit; and 
[0022] FIGS. 13A, 14A and 15A show input or preprocessed images, and 
FIGS. 13B, 14B, and 15B show regions into which an image is sectioned by 
the method and apparatus for sectioning an image into a plurality of regions 
according to the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 
[0023] Referring to FIG, 1, a method for sectioning an image into a plurality 
of regions includes converting each pixel of an input image into color 
coordinates in an Lap color space and partitioning the color space into layers 
and bins (steps 10 and 12), obtaining an upper last circle and a lower last 
circle using a mean-shift analysis (steps 14 and 16), and forming and 
partitioning clusters (steps 18 - 26), and generating and simplifying an image 
graph using clusters (steps 28 - 30). 

[0024] Referring to FIG. 2, an apparatus for performing the method for 
sectioning an image into a plurality of regions shown in FIG. 1 includes an 
image preprocessor 32, a feature value calculator 34, a main region section 
unit 36, and an image graph simplification unit 38. 

[0025] Referring to FIGS. 1 and 2, the main region section unit 36 converts 
each pixel of the input image into color coordinates in the La3 color space 
(step 10). in this case, L is luminance, and a and (3 are color components, all 
of which are defined by Equation (1): 



L = 



r+ g+ b 



a = (T-g)^2 



...(1) 



where r, g and b denote color values of each pixel. 
[0026] In step 10, the main region section unit 36 may input an image 
through an input terminal INI or from the image preprocessor 32 as shown 
in FIG. 2. For example, the image preprocessor 32 repeatedly smooths the 
image input through the input terminal INI a predetermined number of times 
and outputs an image preprocessed by enhancing edges in the smoothed 
image to the feature value calculator 34 and to the main region section unit 
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36. As a consequence, the main region section unit 36 can convert the 
smoothed image output from the image preprocessor 32 or each pixel of the 
image input through the input terminal IN1 into color coordinates in the Lap 
color space. 

[0027] Smoothing of an input image performed by the image preprocessor 
32 will now be described in detail. 

[0028] In general, an input image such as that captured through a camera 
sensor or a video image signal is composed of two portions: noise and a 
meaningful signal. Here, each component of an image includes different 
kinds of information. This method for statistically dividing two portions 
allows the input image to be broken into various different components . For 
example, the image preprocessor 32 performs an edge-preserving image 
smoothing process in such a way as to filter out noise by smoothing the 
input image and to preserve edges of an object by decomposing the 
smoothed image into a portion having an outstanding edge and a portion 
having no outstanding edge. This edge-preserving image smoothing is 
disclosed in "Two Tasks in Image Enhancement Technology" by P.A. 
Chechia, Optical Memory and Neural Networks, 1998, and summarized as 
follows. 

[0029] If a set {x} of pixels in a window of a predetermined size is defined by 
Equation (2), windows of different sizes are applied to smooth pixels 
excluding those having outstanding luminance values among pixels in each 
window. 

{x}-x,<X2,...,<x,(Xi€W_) ...(2) 

[0030] Luminance value obtained after smoothing of an input image is 
repeated q times is calculated in a window W^^nn using the previously 
obtained luminance value l'''^rnn. expressed by Equation (3): 
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2xw(x-ir;) 

[0031] Here, w(x') is a predetermined weiglit function. If x" is between -a and 
+a w(x') = 1 , and if not, w(x') = 0. The luminance value F'^^nn refers to a 
central value of the weight function w(x') in a previous window VV^'^rnn- ^mn is 
used in place of in initial smoothing of the input image. In this case, a 
luminance value s'^n of a pixel which has been smoothed Q times is 
represented by Prnn- That is, the luminance value s'^^^ refers to a result of 
smoothing a pixel with Q windows. It is experimentally shown that 
smoothing is preferably performed twice. A square window having sides of 
length 3-5 pixels was used for first smoothing, and a square window having 
sides of length 10-40 pixels was used for second smoothing. The use of 
these windows has proven effective in extracting smoothed components 
from an image which contains a large amount of noise, and in this case, an 
acceptable mean square error of a computed result value was within 0.5 %. 
[0032] Following step 10, the Lap color space is partitioned into layers along 
an L-axis, and each layer is partitioned again into bins along a- and p- axes 
(step 12), In this case, the positions X and Y of pixels contained in each 
layer on an image plane are stored. 

[0033] The layers and bins formed in step 12 will now be described with 
reference to FIG. 3. Referring to FIG. 3, which shows the Lap color space for 
layers and bins, the Lap color space is partitioned into a plurality of layers 40, 
42, 44, and 46, and each of the plurality of layers 40, 42, 44, and 46 is 
partitioned into a plurality of bins. For example, the layer 40 is composed of 
a plurality of bins 50, 51 , 52, 53, 54, the layer 42 is composed of a 
plurality of bins 60, 61 , 62, 64, and the layer 46 is composed of a plurality 
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of bins 70, 71 , 72, 74, .... Each axis has a range from 0 to 2^-1 , and each 
bin is a cube whose length, width, and height are p". 
[0034] First, it is assumed that the L-axis defines 2 to the 8th power (256) 
different brightness (p'=8), the a- and p- axes define 2 to the 8th power (256) 
different colors (p -8), and p"=4. It is further defined that, of two layers 
shown in FIG. 3, one layer having lower brightness is a "lower layer" and the 
other layer having higher brightness is an "upper layer". That is, the layer 
40 is an upper layer to the layer 42, and the layer 42 is a lower layer to the 
layer 40. Similarly, the layer 42 is an upper layer to the layer 44, and the 
layer 44 is a lower layer to the layer 42. 

[0035] Under the above assumption, four brightness values on the L-axis in 
the color space with L, a, and p coordinate axes are assigned for each layer, 
which partitions the color space into 64 layers 40, 42, 44, ... , and 46. That 
is, brightness values 255, 254, 253, and 252 are assigned to the layer 40. 
Similarly, the color space is partitioned along the a- and p- axes such that each 
of the layers 40, 42, 44, and 46 has 64 x 64 bins. 
[0036] Following step 12, an upper last circle, in which pixels having 
features most similar to that of an initial pixel located at a predetermined 
position within a local maxima among the bins 50, 51 , 52, 53, 54, ... 
contained in the first upper layer 40 shown in FIG. 3 are most densely 
arrayed, is obtained by mean-shift analysis (step 14). Here, the local 
maxima refers to a bin including the largest number of pixels among bins 
included in a particular layer. 

[0037] A preferred embodiment of a mean-shift analysis used when the 
main region section unit 36 performs step 14 will now be described with 
reference to FIGS. 4 and 5. Referring to FIG. 4, a mean-shift analysis 
method according to the present invention includes calculating an average 
color, an average texture, and an average position X and Y on an image 
plane for pixels selected among pixels contained in an upper arbitrary circle, 



-10- 

comparing the average color, the average texture and the average position 
for the selected pixels with those for a base pixel, and determining whether 
the averages of the selected pixels converge (steps 90 - 96). Steps 90 - 96 
are repeated until a converged upper arbitrary circle is obtained. The 
nriethod further includes determining the converged upper arbitrary circle as 
an upper last circle (step 98). 

[0038] Referring to FIGS, 5(a) and (b) which explain a mean-shift analysis 
method, an upper layer 120 in FIG. 5(a) consists of one or more upper 
arbitrary circles 106, 108, and 110, while a lower layer 130 in FIG. 5(b) 
consists of one or more lower arbitrary circles 132, 134, and 136. Here, 
the abscissa of each layer 120 or 130 is a p axis and the ordinate is an a axis, 
which are same as the a- and (3- axes in the color space shown in FIG. 3. in 
order to explain the mean-shift analysis of the present invention, the layers 
120 and 130 are shown as each having a plurality of arbitrary circles 106, 
108, 110, 132, 134, and 136. However, each layer 120 or 130 may have 
only a single arbitrary circle. 

[0039] First, among pixels included in the first upper arbitrary circle 106 
having a center at a predetermined location 100 in the upper layer 120 
having the highest brightness as shown in FIG. 5(a) and a radius of Oc, only 
pixels whose texture feature values are less than a texture feature value of a 
pixel located at the center 100 of the first upper arbitrary circle 106 
(hereinafter called "base pixel") by a texture distance Og and which are spaced 
apart less than a predetermined distance Oq from the position of the base 
pixel on an image plane, are selected (step 90). The texture feature values 
of each pixel required for performing step 90 are output from the feature 
value calculator 34 of FIG. 2. 

[0040] The operation of the feature value calculator 34 of FIG. 2 will now be 
described. The feature value calculator 34 computes color feature values 
and texture feature values on a pixel-by-pixel basis from the preprocessed 
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image output from the image preprocessor 32, and outputs the computed 
color and texture feature values to the main region section unit 36 and the 
image graph simplification unit 38. 

[0041] With reference to the color feature values computed in the feature 
value calculator 34, first, a color feature space and a texture feature space 
are used together to provide a basis for a general feature space. In this 
case, color feature values of each pixel in an image can be specified by 
defining the color and texture feature spaces. The color feature values, i.e., 
brightness (B), hue (H), and saturation (S) of each pixel, are defined by 
Equations (4): 



B 



3 



H= r-— ^+60% if r= u 

g + b - 211 



120^(r-u) 

+ 180 , if g = u 



b+r"2u 
120°(g-u) 
r + g - 2u 



+ 300% if b = u 



S=l- ^ ...(4) 

r+ g+ b 



where u=min(r, g, b) 

[0042] Next, with reference to the texture feature values calculated in the 
feature value calculator 34, each of texture feature values of multiple scales 
and multiple orientations used for forming a texture feature space is 
obtained by calculating a local variation v and a local oscillation f for each 
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pixel in multiple directions and connbining them. This texture image analysis 
is called a Gray Level Difference Method. The Gray Level Difference 
Method is disclosed in "Some Basic Texture Analysis Techniques" (E. J, 
Carton, J.S. Weszka and A, Rosenfeld, TR-288, Univ of Maryland, 1974) 
and "Texture Analysis Anno" (L. Van Gool, P. Dewaele and A. Oosterlinck, 
CVGIP, 1985). The brightness (B) of an image defined by Equation (4) is 
used in extracting the texture feature values. 

[0043] With regard to local variation v, pixels having length 2L* having a 
pixel (m, n) as a center exist in an image, and the pixels are turned around 
the pixel (m,n) at angle a\ = kn/K, m and n are the same as the spatial 
positions X and Y of a pixel on an image plane, and k = 0, 1 , ... , K-1 . 
Assuming that 1; represents the brightness (B) of a pixel among pixels 
uniformly arrayed in this way, where -U < i < L', an upward weight variation 
v^ and a downward weight variation v are expressed by Equations (5): 

L-1 

- X Widi, if di> 0 

••(5) 

v-= Sw,(-d,), ifdUO 

i=-L 

where dj denotes a gradient li^.-, - 1; between brightnesses of adjacent pixels 
in the pixel array and w, is a cosine weight function Acos(in/(2U+1 ). A 
coefficient A in the cosine weight function Wj is used for establishing 

L 

^ Wj = 1 . In this case, local variation v^ is designated as the smaller of 

i=-L 

the upward weight variation v"^ and the downward weight variation v as 
expressed by Equation (6): 
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[0044] A local oscillation f is defined by the number of dj (d; denotes the 
magnitude of oscillation), the magnitudes of which exceed a predetermined 
threshold value at the same time that the signs are changed among dj 
calculated along a length 2L' of the array, where -U < i < L\ In this case, 
local variation and local oscillation f^ for each pixel are multiplied to obtain 

A 

texture feature values \ {=yA) for a corresponding pixel. Furthermore, to 
make the calculated texture feature values more equal, Equation (7) is used: 

tanh[^XC(h)] ...(7) 

h 

[0045] As is evident from Equation (7), the texture feature values t^ are 
smoothed as an average of a window having a size of h x 1 , and high and 
low texture feature values are made lower and higher, respectively, due to 
modification using a hyperbolic tangent function 'tanh'. In this case, when 
the size of an image is reduced Z times (by a half every time) at different 
frequencies, the texture feature values t^ for each pixel defined by Equation 
(7) can be expressed by Equation (8): 

tj= taiih[aXtJ(h)] ...(8) 

h 

[0046] As is evident from Equation (8), KZ texture feature values t^^ are 
produced for each pixel. 

[0047] Turning to FIG. 4, after step 90, the main region section unit 36 
calculates an average color, an average texture, and an average position on 
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an image plane for the selected pixels (step 92). Here, the average color 
means an average of color components a and |3 for the selected pixels in the 
layer on the given L and is called average Lap. The average texture means 
average of textures for the selected pixels, and the average position means 
an average of positions for the selected pixels. Then, when each of the 
calculated averages is compared with each average of the base pixel 100 
which is the center of the first upper arbitrary circle 106, it is determined 
whether a spacing degree is less than or equal to a first predetermined 
value (step 94). Here, in step 94, the spacing degree is calculated from 
differences between the averages obtained in step 92 and the averages of 
the base pixel 100 as will be described below. If the calculated spacing 
degree is greater than the first predetermined value, a pixel, the center of 
which is a position 102 corresponding to the average color obtained in step 
92, is designated as an imaginary base pixel, and texture feature values and 
a position on an image plane for the imaginary base pixel are designated as 
the average texture and the average position calculated in step 92. Then, a 
new upper arbitrary circle, i.e., the second upper arbitrary circle 108 having 
the center of the new base pixel 102 at the position 102, is determined, and 
the process returns to step 90 (step 96). 

[0048] Steps 90 - 96 are performed in the direction indicated by an arrow 
122 shown in FIG. 5(a) until the spacing degree is less than or equal to the 
first predetermined value, that is, an average color, an average texture, and 
an average position on an image plane for selected pixels in an upper 
arbitrary circle converge on feature values (color, texture, and position) of a 
base pixel of the upper arbitrary circle. That is, as shown in FIG. 5(a), if the 
spacing degree obtained from the differences between the averages (color, 
texture, and position) for an upper arbitrary circle 110 and the features 
(color, texture and position) of a base pixel 104 at the center of the upper 
arbitrary circle 1 10, is less than or equal to the first predetermined value, the 
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upper arbitrary circle 1 10 Is determined as an upper last circle 84 sfiown in 
FIG. 3 (step 98). Here, the upper last circle 84 or 1 10 includes the largest 
number of pixels having feature values most similar to those of the 
imaginary base pixel 104. 

[0049] Turning to FIG. 1, after step 14, an imaginary base pixel having the 
same features (texture and position) as the base pixel of the upper last 
circle 84 is set at the same position a and (3 as the center of the upper last 
circle 84 in the lower layer 42 successively adjacent to the upper layer 40, 
and a lower last circle 82 including the largest number of pixels having 
feature values most similar to those of the imaginary base pixel is obtained 
by the mean-shift analysis (step 16). 

[0050] A mean-shift analysis method according to a preferred embodiment 
of the present invention used when the main region section unit 36 performs 
step 16 will now be described with reference to FIG. 6. 
[0051] Referring to FIG. 6, the mean-shift analysis method according to the 
present invention used in performing step 16 shown in FIG. 1 includes 
obtaining an average color, an average texture, and an average position X 
and Y on an image plane for pixels, which are selected among pixels 
contained in a lower arbitrary circle until a converged lower arbitrary circle is 
obtained (steps 150 - 156), and determining the converged lower arbitrary 
circle as a lower last circle (step 158). 

[0052] Referring to FIGS. 5(a) and (b), among pixels included in the first 
lower arbitrary circle 132, having its center at the same location 140 in the 
lower layer 130 as the center 104 of the upper last circle 110 and having a 
diameter of o^, only pixels whose texture feature values are less than those of 
the set base pixel 140 by Oq and which are spaced apart less than a 
predetermined distance Oq from the position of the base pixel 140 on an 
image plane, are selected (step 150). The texture feature values used in 
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performing step 150 are calculated by the feature value calculator 34 as 
described above. 

[0053] In a preferred embodiment of the present invention, pixels are 
selected among pixels in an arbitrary circle in steps 90 and 150 in the 
following manner. First, using differences AX and AY between positions on an 
image plane, differences Aa and Ap between color components, and 
differences AG between texture feature values of any pixel located in an 
upper (or lower) arbitrary circle and a central pixel located at the center of 
that upper (or lower) arbitrary circle, a distance A' between any pixel and the 
central pixel is obtained according to Equation (9): 



AX^+ AY^ A^^+ A^' 



(9) 



where 9 denotes an arrangement 9[KZ] of KZ texture feature values for each 
pixel obtained from Equation (8) as a texture response, and denotes a 

texture distance at an i-th size among K different sizes. 
[0054] If the distance A' obtained as defined by Equation (9) is less than a 
second predetermined value, for example, '1\ the pixel is selected as a pixel 
considered for any average value. If not, the pixel is not selected. 
[0055] After step 150, an average color, i.e., an average Lap, an average 
texture, and an average position on an image plane are calculated for pixels 
selected among pixels in the first lower arbitrary circle 132 (step 152). Here, 
each average is calculated in the same way as described for step 92. After 
step 152, when each of the calculated averages is compared with each 
feature value of the base pixel at the center 140 of the first lower arbitrary 
circle 132, it is determined whether or not the spacing degree is greater than 
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a first predetermined value (step 154). Here, tlie spacing degree used for 
step 94 or 154 is calculated by using Equation (9). TInat is, in step 94 or 
154, in order to obtain the spacing degree A', differences between average 
position obtained in step 92 or 152 for any upper (or lower) arbitrary circle 
and position on an image plane of a central pixel in that upper (or lower) 
arbitrary circle are substituted for AX and AY, differences between average 
colors and color components of the central pixel are substituted for Aa and 
Ap, and the difference between average texture and a texture feature value 
of the central pixel is substituted for A6 in Equation (9). If the calculated 
spacing degree is greater than the first predetermined value, a pixel at a 
position 142 corresponding to the average color obtained in step 152 is 
designated as an imaginary base pixel, and a texture feature value and a 
position on an image plane for the base pixel are designated as the average 
texture and the average position calculated in step 152. Then, a new lower 
arbitrary circle, i.e., the second lower arbitrary circle 134 having the new 
base pixel at its center 142, is determined, and the process returns to step 
150 (step 156). 

[0056] Steps 150-156 are performed in the direction indicated by an arrow 
138 shown in FIG. 5(b) until the spacing degree is less than or equal to the 
first predetermined value, that is, an average color, an average texture, and 
an average position on an image plane for selected pixels in a lower 
arbitrary circle converge on feature values (color, texture, and position) of a 
base pixel of the upper arbitrary circle. That is, as shown in FIG. 5(b), if the 
spacing degree obtained from the differences between the averages (color, 
texture, and position) for a lower arbitrary circle 136 and the features (color, 
texture and position) of a base pixel at the center 144 of the lower arbitrary 
circle 136 is less than or equal to the first predetermined value, the lower 
arbitrary circle 136 is determined as a lower last circle 82 shown in FIG. 3 
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(step 158). Here, the upper last circle 82 or 136 includes the largest number 
of pixels having feature values nnost similar to those of the base pixel 144. 
[0057] As described above, since a layer having lower brightness and a 
layer having higher brightness are defined as a 'lower layer' and an 'upper 
layer', respectively, the last circle for the layer having lower brightness is 
obtained after the last circle for the layer having higher brightness is 
obtained in steps 14 and 16. Conversely, if the layer having higher 
brightness and the layer having lower brightness are defined as a "lower 
layer* and an "upper layer", respectively, a last circle for the layer having 
higher brightness is obtained after a last circle for the layer having lower 
brightness is obtained in steps 14 and 16. 

[0058] Turning to FIG. 1, after step 16, an upper last circle determined in an 
upper layer is selectively connected to a lower last circle determined in a 
lower layer (step 18) to cluster pixels having similar saturations and 
gradually varying brightnesses due to a shading effect (step 20). For 
example, after step 16, it is determined whether a distance [ (a2 - a^)^ + (32 - 
^^fV^^ between the center (a-,, p-,) 104 of the upper last circle 110 and the center 
(a2, Ps) of the lower last circle 136 is less than a first threshold value thi (step 
1 8). If the distance is less than the first threshold value thi , the upper last 
and lower last circles 110 and 136 (or 84 and 82) are included in the same 
cluster 86 (step 20). 

[0059] FIG. 7A shows an example of a cluster 160 formed by the method 
and apparatus for sectioning an image into a plurality of regions shown in 
FIGS. 1 and 2, in which the cluster 160 includes a plurality of last circles 
170, 172, 174, 176, 178, and 180. FIG. 7B is a graph for explaining a local 
minimum, in which the number of pixels is plotted against the layer. 
[0060] After step 20, it is determined whether another lower layer 
successively adjacent to the lower layer exists (step 22). That is, it is 
determined whether a last circle is obtained for the last layer 46. If an 
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adjacent lower layer exists, that is, unless a last circle is obtained for the last 
layer 46, the process returns to step 16. in this case, steps 16-22 are 
performed on the lower layer, which is a new upper layer, and the adjacent 
lower layer, which is a new lower layer. For exannple, in a case where steps 
16-22 are performed for obtaining a last circle for another lower layer 44, 
the previous lower layer 42 is a new upper layer and the lower layer 44 is a 
new lower layer. 

[0061] However, if the distance between the center (a-,, P^) 104 of the upper 
last circle 1 1 0 and the center {a^, ^2) of the lower last circle 1 36 is no less than 
the first threshold value thi , or if an adjacent lower layer does not exist, the 
cluster 160 is partitioned using a last circle including the smallest number of 
pixels in a color space used in calculating an Lap average among the last 
circles 170, 172, 174, 176, 178, and 180 included in the cluster 160 shown 
in FIG. 7A (step 24). That is, if the distance is no less than the first 
threshold value th1 , there is no adjacent lower layer or one cluster ceases to 
be formed and then step 24 is performed. Step 24 is performed to minimize 
an error caused by including various objects having similar chromatic 
characteristics but different brightnesses in the same cluster. For example, 
if the last circles 170, 172, 174, 176, 178, and 180 use 5, 15, 23, 17, 34, and 
14 pixels, respectively, in order to calculate the Lap average, the cluster 160 
shown in FIG. 7A is partitioned using the last circle 176 including only 17 
pixels. Here, the circle 176 corresponds to a local minimum mode 190 as 
shown in FIG. 7B. 

[0062] After step 24, it is determined whether pixels not included in any last 
circle 84, 82 or 80 exist in any layer 40, 42, 44, and 46 (step 26). If 
pixels not included in any last circle 84, 82 or 80 exist in each of the 
layers 40, 42, 44, and 46, the process returns to step 14 in order to 
perform steps 14 - 24 on the remaining pixels not included in any last circle 
84, 82 or 80. However, if such pixels do not exist, an image graph is 
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generated from a fundamental region division map obtained by using 
clusters available for all pixels in the color space (step 28). 
[0063] FIG. 8 is an example of a fundamental region division map consisting 
of five regions 200, 202, 204, 206, and 208 which are assigned region 
numbers 1,2,3, 4, and 5, respectively. FIG. 9 is an example of an image 
graph generated from the fundamental region division map shown in FIG. 8. 
As is evident from FIG. 9, adjacent regions on the fundamental region 
division map are connected to one another. Here, ®, (D, (D, ®, and ® 
denote the five regions 200, 202, 204, 206, and 208 shown in FIG. 8, 
respectively. 

[0064] The main region section unit 36 generates the fundamental region 
division map shown in FIG. 8 from the clusters obtained by performing steps 
10-26, and generates the image graph of FIG. 9 using the fundamental 
region division map (step 28). In this case, the main region section unit 36 
stores information about each region such as the number of pixels, an 
average color, and texture feature values. In particular, the average color is 
obtained averaging brightnesses, hues, and saturations (BHS) of pixels 
calculated by the feature value calculator 34. Here, the image graph of FIG. 
9 provides information about what regions are adjacent to each other in the 
fundamental region division map of FIG. 8 and information about weight 
values wtl , wt2, wt3, wt4, and wt5 for lengths of edges between adjacent 
regions. 

[0065] After step 28, the image graph simplification unit 38 of FIG. 2 
compares the color-texture distance input through the input terminal IN2 with 
a second threshold value th2, merges regions marked in the image graph 
output from the main region section unit 36 according to the comparison 
result to generate a final image graph, and outputs the generated final 
image graph through the output terminal 0UT1 (step 30). Step 30 will now 
be described in detail. 
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[0066] FIG. 10 is a block diagram of an apparatus for measuring a color- 
texture distance used in performing step 30 shown in FIG. 1. Referring to 
FIG. 10, the apparatus includes a color distance calculator 210, a texture 
distance calculator 212, and a color-texture distance generator 214. More 
specifically, the color distance calculator 210 inputs color feature values of 
each of two points x and y such as brightness (B), saturation (S), and hue 
(H) through an input terminal IN3 in a color feature space composed of color 
feature values of pixels in an image. Then, the color distance calculator 210 
assigns different degrees of importance to a difference between input 
brightnesses, a difference between input saturations, and a difference 
between input hues, adds the brightness difference, the saturation 
difference, and the hue difference in proportion with the assigned degrees of 
importance, and outputs the added result to the color-texture distance 
generator 214 as a color distance between the two points x and y. In this 
case, the above degree of importance is determined in a color feature space 
composed of BHS using the following three standard conditions. First, hue 
(H) is a more important factor in determining importance than brightness (B) 
and saturation (S) Second, if brightness (B) approaches an absolute value 
'0', the color of an image is black without regard to hues (H) or saturation 
(S). Third, if saturation (S) approaches an absolute value "0', that is, the 
color of an image is gray, hue (H) has an arbitrary value. 
[0067] The color distance calculator 210 assigns degrees of importance 
determined on the basis of the above-mentioned standard conditions to the 
brightness difference, the saturation difference, and the hue difference to 
obtain a color difference [DBHsi(x,y)], expressed by Equation (10): 



DBHsi(x.y)= wJb(x)- B(y)|+ FH[min(S(x),S(y))](aB+ b)S|H(x)- H(y)| + 
Fs(S)B|S(x)-S(y)| 
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[0068] Here, B(o), H(o), and S(o) denote color feature values, i.e., 
brightness, hue, saturation of point o (o refers to x or y), respectively, and B 

and S denote the average of B(x) and B(y) and the average of S(x) and 
S(y), respectively. Wg, a and b are constants, and FsG) and FhO) denote 
linear correction functions for saturation and hue, respectively. In this case, 
the linear correction function FgO) or FhO) employed to suppress the 
difference between hue and saturation under conditions of low brightness 
and low saturation. For this purpose, the linear correction function Fs(j) or 
FhO) is j if j is less than 1 , and 1 if j is 1 or greater. 

[0069] As is evident from Equation (10), the brightness difference [B(x) - 
B(y)], the hue difference [H(x) - H(y)], and the saturation difference [S(x) - 
S(y)] have different coefficients which are determined according to the 
degrees of importance as described above. 

[0070] In this case, the color distance calculator 210 may obtain a color 
distance [DBHS2^(x.y)] by assigning degrees of importance determined based 
on the above-mentioned standard conditions to the brightness difference, 
the saturation difference, and the hue difference expressed by Equation (11) 
in place of Equation (10): 



DHt^^(x,y) = W3[B(x) - B(y)]^ + W^F3[B(x),B(y)]Fs[S(x),S(y)][H(x) - H(y)]^ + 
W3F3[B(x),B(y)][S(x)- S(y)]^ 

where Wh and Wg are constants, and Fs (• , •) and F^ (• , •) denote nonlinear 
correction functions for saturation and brightness, respectively. 
[0071] As is evident from Equation (11), the square of brightness difference 
[B(x) - B(y)]^, the square of hue difference [H(x) - H(y)]^, and the square of 
saturation difference [S(x) - S(y)]^ have different coefficients which are 
determined according to degrees of importance as described above. 
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[0072] If the color distance calculator 210 calculates a color distance using 
Equation (10) or (11), image segmentation can be stably made in a regular 
way without being affected by the change in brightness. Furthermore, in 
order to enhance discrimination of low brightness region, the color distance 
calculator 210 may compute a color distance [DBHS3(x,y)] as defined by 
Equation (12): 



where Dbhs denotes the color distance [DBHsi(x»y)] o^" [DBHS2^(x.y)] expressed 
by Equation (10) or (11). 

[0073] Meanwhile, the texture distance calculator 212 shown in FIG. 10 
inputs from the feature value calculator 34 texture feature values of two 
points X and y through an input terminal IN4 in a texture feature space 
composed of texture feature values for pixels. Then, the texture distance 
calculator 212 detects a difference between the input texture feature values, 
calculates a texture distance between the two points x and y using weighting 
coefficients applied to multiple scales of a texture and the detected 
difference, and outputs the calculated texture distance to the color-texture 
distance generator 214, For example, the texture distance calculator 212 
may calculate a texture distance (x, y) as expressed by Equation (13): 



DBtK(^.y)-DBHs*{1.0-f 



a 



a 



...(12) 



min(B(x),B(y)) / 256 + ' 1 .0 + ' 



z 



K 




...(13) 



where W denotes the weighting coefficient applied to the multiple scales of 
a texture. 
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[0074] The color-texture distance generator 214 connputes a color-texture 
distance using a color weight value (u', v') and a texture weight value w^ 
(u', v') that vary depending on characteristics of segmented regions u' and 
v'. Here, the characteristics of the segmented regions u" an V mean a 
texture degree t(u', v'), a size p(u', v') and a saturation s(u', V) for the 
segmented regions u' and v' marked in the fundamental region division map 
of FIG. 8. That is, the color-texture distance generator 214 multiplies a 
variable color weight value w^ (u\ v') and a variable texture weight value w^ 
(u', v') by the color distance as expressed by Equation (10), (11), or (12) and 
the texture distance as expressed by Equation (13), respectively, adds the 
multiplication results to each other, and outputs the added result to the 
image graph simplification unit 38 as a color-texture distance through an 
output terminal 0UT2. 

[0075] FIG. 1 1 is a block diagram of the color-texture distance generator 
214 shown in FIG. 10. Referring to FIG. 1 1 , the color-texture distance 
generator 214 includes a color weight value calculator 220, a texture weight 
value calculator 222, first and second multipliers 224 and 226, and an adder 
228. 

[0076] The color weight value calculator 220 shown in FIG. 1 1 calculates a 
color weight value w^, (u', v') as expressed by Equation (14) and outputs the 
calculated color weight value to the first multiplier 224: 

w^(u' , V* ) = w,[l - t(u' , v' )p(u' , V* )]s(u\ ) ■■•(14) 

A A 

where Wc and Wt denote color and texture weighting constants, 
respectively. A texture degree t(u', v') is defined by Equation (15): 
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^ , ,^ T(u')+T(v') 

max 



where T^a^ denotes a maximum of texture degree. T(u') is defined by 
Equation (16): 

Z K 

T(u')=2 W"Ztk(u') •••(16) 

z=l k=l 

where tk^(u') denotes an average texture feature value having a direction k at 
a size z of the region u\ A weight value w^ denotes the weighting coefficient 
shown in Equation (13). Furthermore, p(u" v') in Equation (14) is expressed 
by Equation (17): 



P(u\v')-F 



min[P(u*),P(v')] 



o 



.(17) 



where Pq denotes a threshold value for the sizes of segmented regions 
marked in a fundamental region division map. s(u'y) in Equation (14) is 
expressed by Equation (18): 



s(u',v')= 0.5+0.5F 



max[S(u'),S(v')] 



.(18) 



where Sq denotes a saturation threshold value. Functions F in Equations 
(17) and (18) are used to suppress an adverse effect caused by extremely 
small-sized or low saturation regions. The texture weight value calculator 
222 shown in FIG. 1 1 calculates a texture weight value w^ (u', v') as 
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expressed by Equation (19) and outputs the calculated texture weight value 
to the second multiplier 226: 



AAA 



w,(u' , ) = [1 - s(u' , )](w^4- w,)+ s(u' , )t(u' , )p(u' , ) "(l^) 



[0077] The color weight value calculator 220 and the texture weight value 
calculator 222 shown in FIG. 1 1 input an average texture feature value 
through an input terminal IN6 (the input terminal 1N6 corresponds to the 
input terminal INS shown in FIG. 10). Also, the color weight value calculator 
220 and the texture weight value calculator 222 may receive as input 
required values among the color and texture weighting constants, the 
maximum of a texture degree, the average texture, the weighting coefficient, 
and the threshold values for the sizes and saturations of segmented regions 
marked in a fundamental region division map from the outside through the 
Input terminal IN6, or may prestore them. 

[0078] The first multiplier 224 multiplies the color weight value w^ (u', v') 
output from the color weight value calculator 220 by a color distance as 
defined by Equations (10), (11) or (12) and outputs the multiplication result 
to the adder 228. The second multiplier 226 multiplies the texture weight 
value Wt (u', v') output from the texture weight value calculator 222 by a 
texture distance as defined by Equation (13) and outputs the 
multiplication result to the adder 228. The adder 228 adds the multiplication 
result from the second multiplier 226 to the multiplication result from the first 
multiplier 224 and outputs the result as expressed by Equation (20) to the 
image graph simplification unit 38 through an output terminal 0UT3 as a 

A 

color-texture distance D(u\v') required for simplifying an image graph. 
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D(u\ V' ) = w^(u' , )D,(u' , V' ) + w,(u' , V' )D,(u' , v' ) --(20) 

where Dc{u'y) and Dt{u',v') denote color and texture distances, respectively. 
[0079] As described above, the color weight value w^ and the texture weight 
value Wt, which are utilized for calculating the color-texture distance used in 
the image graph simplification unit 38, are not predetermined values but 
variables. This is because the color-texture distance needs to be adjusted if 
the texture degrees, sizes and saturations of segmented regions vary. For 
example, if the sizes p(u'y) of the segmented regions u' and v' are less than 
the threshold value Pq for the sizes of segmented regions, the color weight 
value Wc (u', v*) shown in Equation (20) increases while the texture weight 
value Wt (u', v') decreases. If the texture degrees t(u',v') of the segmented 
regions u' and v' increase, the color weight value w^ (u', V) decreases while 
the texture weight value Wt (u', v') increases. 

[0080] A process of performing step 30 by the image graph simplification 
unit 48 using the color-texture distance calculated as described above will 
now be described. 

[0081] First, regions marked in the image graph output from the main region 
section unit 36 are arranged in order of decreasing size. Next, the color- 
texture distance between an arbitrary central region (hereinafter called 
"base region") and each of adjacent regions connected to the base region 
among the arranged regions is calculated using Equation (20). If the 
calculated color-texture distance is less than or equal to the second 
threshold value th2, the base region and the adjacent regions are merged. 
That is, the adjacent regions are merged into the base region. If the base 
region embraces its adjacent regions in this way, a portion of the image 
graph relating to the base region such as a connection relationship between 
the base region and each adjacent region needs to be modified as features 
of the base region such as color, texture, size, and edges change. The 
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merging of a newly modified base region and its adjacent regions can be 
performed in the same manner. When the process of modifying the base 
region and merging adjacent regions into the modified base region is 
finished, the next largest region is newly designated as a base region to 
perform the region merging process again. The merging process is 
repeated until it has been performed on all regions marked in the image 
graph. 

[0082] A process of simplifying the image graph cannot be perfectly 
conducted regardless of the second threshold value th2. To overcome this 
problem, the image graph simplification unit 38 may be divided into a 
plurality of sub-region merging portions. For this purpose, the color and 
texture weight values and the color and texture distances in Equation (20) 
are different in each sub-region merging portion, and the second threshold 
value th2 dynamically changes depending on the size of a region. 
[0083] More specifically, FIG. 12 is a block diagram of the image graph 
simplification unit 38. Referring to FIG. 12, the image graph simplification 
unit 38 includes primary, secondary, and tertiary region merging portions 
240, 242 and 244,and a threshold value generator 246. The threshold value 
generator 246 dynamically changes the second threshold value th2 as 
expressed by Equation (21) and outputs the second threshold value th2 to 
the primary, secondary, and tertiary region merging portions 240, 242, and 
244: 

[0084] Here, P denotes the size of a smaller region of two compared 
regions, and P'o is a constant representing a predetermined size that the 
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smaller region can typically have, a denotes a threshold value constant and a 
is a threshold value for a larger region of the two compared regions. 
[0085] The primary region merging portion 240 compares the color-texture 
distance as defined by Equation (20) input through an input terminal INS 
with the second threshold value th2 received from the threshold value 
generator 246, merges two segmented regions u" and v' marked in the 
image graph input through an input terminal IN7 if the color-texture distance 
is less than or equal to the second threshold value th2, and outputs a first 
intermediate image graph reflecting the final result of merging in this way to 
the secondary region merging portion 242. The performance of the primary 
region merging portion 140 can be improved by gradually increasing the 
threshold value constant a' in Equation (21). 

[0086] The secondary region merging portion 242 compares a first color- 
texture distance input through the input terminal INS with the second 
threshold value th2 received from the threshold value generator 246, 
merges two regions u" and v" marked in the first intermediate image graph if 
the first color-texture distance is less than or equal to the second threshold 
value th2, and outputs a second intermediate image graph reflecting the 
final result of merging in this way to the tertiary region merging portion 244. 
Here, the first color-texture distance is obtained by substituting into Equation 
(20) color and texture weight values calculated using Equations (14) and 

A 

(19), respectively, when a color weighting constant Wc is set to "0", and 
texture and color distances calculated using Equation (13) and Equation 
(10), (1 1) or (12), respectively, when Wh « Wb, and Ws « Wg. That is, the 
first and second multipliers 224 and 226 of the color-texture distance 
generator 214 shown in FIG. 1 1 multiply a color weight value w^ (u",v") and 
a texture weight value Wt (u",v") output from the color weight value calculator 
220 and the texture weight value calculator 222, respectively, when the 

A 

color weighting constant Wc is '0', by a color distance and a texture 
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distance, respectively, which are output from the color and texture distance 
calculators 210 and 212, respectively, when Wh « Wg, and Ws « Wg. In 
this case, the adder 228 adds the multiplication results to each other, and 
outputs the addition result to the image graph simplification unit 38 through 
the output terminal OUTS as the first color-texture distance. This process 
can be performed only when the regions u" and v" have very low brightness. 
[0087] The tertiary region merging portion 244 compares a second color- 
texture distance input through an input terminal IN8 with the second 
threshold value th2 received from the threshold value generator 246, 
merges two regions u'" and v"' marked in the second intermediate image 
graph if the second color-texture distance is less than or equal to the second 
threshold value th2, and outputs a final image graph reflecting the final 
result of merging in this way through an output terminal OUT4. Here, the 
second color-texture distance is obtained by substituting into Equation (20) 

A A 

color and texture weight values calculated when Wc « Wt from the 

Equations (14) and (19), respectively, and color and texture distances 
calculated from Equation (10), (1 1) or (12) and Equation (13), respectively 
That is, the first and second multipliers 224 and 226 of the color-texture 
distance generator 214 shown in FIG. 1 1 multiply a color weight value w^ 

A A 

(u"',v"') and a texture weight value Wj (u"',v"') output when Wt « Wc from 

the color weight value calculator 220 and the texture weight value calculator 
222, respectively, by a color distance and a texture distance, respectively. 
In this case, the adder 228 adds the multiplication results to each other, and 
outputs the addition result to the image graph simplification unit 38 through 
the output terminal OUT3 as the second color-texture distance. The tertiary 
region merging portion 244 can perform this process only when the regions 
u'" and v'" have large texture degrees. 



-31- 

[0088] FIGS. 13A and 13B show an input or preprocessed image, and 
regions of the image sectioned by a method and apparatus for sectioning an 
image into a plurality of regions according to the present invention, 
respectively. FIGS. 14A and 14B show another Input or preprocessed 
image, and regions of the image sectioned by a method and apparatus for 
sectioning an image into a plurality of regions according to the present 
invention, respectively. FIG. 15A and 15B show yet another input or 
preprocessed image, and regions of the image sectioned by a method and 
apparatus for sectioning an Image into a plurality of regions according to the 
present invention, respectively. The image shown in FIGS. 13A, 14A, or 
1 5A is segmented into a plurality of clusters of the same regions in the main 
region section unit 36, and the image graph simplification unit 38 merges the 
segmented regions in order to simplify them. In this case, a final image 
graph having Information about the simplified result is used to obtain the 
image sectioned as shown in FIG. 13B, 14B, or 15B. 
[0089] The method and apparatus for sectioning an image into a plurality of 
regions according to the present invention can be effectively used in digital 
interactive video systems. In concert with the popularization of digital 
broadcasting, much research is focused on developing a digital interactive 
video system which enables a user to directly and actively exchange 
information with a broadcaster Instead of passively obtaining information by 
watching a broadcast. For example, in a digital interactive video system, if a 
user directly selects a desired object on a screen in TV dramas, movies, 
educational programs, advertisements, shopping programs, auctions, etc., 
which are broadcast, in order to obtain information about the desired object, 
the information is displayed on the screen. For example, the on-screen 
wardrobe of popular singers, furniture and characters displayed on TV 
dramas, ingredients and recipes required for cooking programs, and so on, 
may be meaningful to the user. If the user selects one of these meaningful 
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objects, information about the selected object can be provided to the user. 
To accomplish this, meaningful objects existing in broadcast images need to 
be effectively distinguished. To effectively differentiate a region occupied by 
a meaningful object from a background or other objects, various features of 
the meaningful object should be utilized to the fullest. The features of the 
selected object may include color, texture and shape. In particular, color or 
texture gives a clue to simplifying the object into a single region. The 
method and apparatus for sectioning an image into a plurality of regions 
according to the present invention includes the use of a mean-shift analysis 
using all information about color feature values, texture feature values, and 
position on an image plane for each pixel. Thus, this invention provides a 
final image graph which can stably and clearly distinguish regions of image 
including the same color and texture feature values as well as regions 
including a three-dimensional object having shades gradually changing 
along an L-axis. 

[0090] Furthermore, in a case where a selected object is composed of 
various colors or various textures, the method and apparatus for sectioning 
an image into a plurality of regions according to the present invention makes 
it possible to effectively distinguish a region of the meaningful object from 
other regions. 

[0091] In addition, the method and apparatus for sectioning an image into a 
plurality of regions according to the present invention may also serve as a 
basic module in products and software relating to digital broadcasting. 
[0092] Meanwhile, the method and apparatus for sectioning an image into a 
plurality of regions according to the present invention can effectively be 
used in searching for and recognizing a meaningful object existing in an 
image and tracking the meaningful object. That is, information about a 
region occupied by the meaningful object is extracted using a final image 
graph generated by the method and apparatus according to this invention. 
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In this case, this invention can be used in searching or recognizing a screen 
on which an object having information similar to the extracted information 
was previously displayed, and tracking all screens on which an object 
having information similar to the extracted information was previously 
displayed. Furthermore, the extracted information may also be used in 
editing or manufacturing an image. 

[0093] Furthermore, if only meaningful objects in an image to be 
compressed according to image compression standards such as MPEG are 
to be effectively transmitted, this invention can maximize transmission 
efficiency by compressing only extracted information more finely. 
[0094] As described above, the method and apparatus for sectioning an 
image into a plurality of regions makes it possible to stably extract regions of 
an image having various features, that is, an image having shades, an 
image including a texture, or image of various color distributions in a form 
similar to what humans can perceive. Furthermore, this invention has a 
wide variety of applications as described above. 



